Skip to content

Add Copeland pairwise scoring as alternative recommendation method#104

Merged
that-github-user merged 1 commit into
mainfrom
issue-103-copeland-scoring
Mar 28, 2026
Merged

Add Copeland pairwise scoring as alternative recommendation method#104
that-github-user merged 1 commit into
mainfrom
issue-103-copeland-scoring

Conversation

@that-github-user

@that-github-user that-github-user commented Mar 28, 2026

Copy link
Copy Markdown
Owner

Summary

  • Copeland scoring: pairwise comparison on tests, convergence, files changed
  • --scoring copeland flag (default: weighted)
  • Per-criterion win/loss breakdown (testsWins, convergenceWins, filesChangedWins)
  • Display shows Copeland table when enabled
  • 8 new tests including: all identical, non-transitive, single agent, dominance

Agent selection: Agent #5 chosen over #3 via manual review (not thinktank scoring — to avoid circular bias in redesigning the scoring system). Agent #5 had more comprehensive tests (21 vs 19) and per-criterion score breakdowns.

Change type

  • New feature

Related issue

Closes #103

How to test

npm test  # 126 tests pass
thinktank run "task" --scoring copeland -n 3
# Shows Copeland Pairwise Scoring table with +/- per criterion

Breaking changes

  • This PR introduces breaking changes

🤖 Generated with thinktank (Opus), agent manually selected

@claude
Add Copeland pairwise scoring as alternative recommendation method
4fb3b3d 
Implement social choice theory-based scoring: agents compared pairwise
on tests, convergence, and files changed. Per-criterion wins tracked.
--scoring copeland flag enables it alongside existing weighted method.

Agent #5 chosen over #3 via MANUAL review (not thinktank scoring) —
better edge case tests (all-identical, non-transitive, single agent)
and per-criterion breakdown in CopelandScore type.

Closes #103

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
@that-github-user

that-github-user commented Mar 28, 2026

Copy link
Copy Markdown
Owner Author

Self-review (manual agent selection):

@that-github-user that-github-user merged commit 102b0e6 into main Mar 28, 2026
4 checks passed
@that-github-user that-github-user deleted the issue-103-copeland-scoring branch March 28, 2026 21:08
@that-github-user that-github-user mentioned this pull request Mar 28, 2026
Closed
4 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

Research: advanced recommendation methods (Copeland, Borda, pairwise comparison)

1 participant

@that-github-user